Notes on the Heaviside Operational Calculus 

By JOHN R. CARSON 

This paper briefly discusses the following topics: (1) the asymptotic solu- 
tion of operational equations; (2) Bromwich's formulation of the Heaviside 
problem, and its relation to the classical Fourier integral; and (3) the 
existence of solutions of the operational equation. The paper closes with 
some general remarks on the interpretation of the operator and the opera- 
tional equation, emphasizing the purely symbolic character of the latter. 

THE large amount of work done in the past thirteen years, start- 
ing with important papers by Bromwich ! and K. W. Wagner, 2 
has served to remove whatever mystery may have surrounded the 
Heaviside operator, and has placed his operational calculus on a quite 
secure and logical foundation. However, certain phases of the prob- 
lem still do not appear to the writer to have as clear or adequate 
treatment as perhaps might be desired; these it is the object of the 
present paper to discuss. The topics dealt with are (1) the asymp- 
totic solution of operational equations; (2) Bromwich's very important 
formula and its relation to the classical Foutier integral; and (3) the 
existence of solutions of the operational equation. 

In the following it will be assumed that the reader has a general 
acquaintance with the Heaviside operational calculus as well as the 
Fourier integral, but a brief sketch of the former may not be out of 
place. It will be recalled that the Heaviside processes were originally 
developed in connection with the solution of electrical problems: 3 
more precisely, the determination of the oscillations of a linearly 
connected system specified by a set of linear differential equations 
with constant coefficients or a partial differential equation of the type 
of the wave equation. This system is supposed to be in a state of 
equilibrium at reference time / = 0, when it is suddenly acted upon 
by a 'unit' force (zero before, unity after time t = 0) ; the subsequent 
behavior of the system is required. In the solution of this problem, 
Heaviside's first step was the purely formal and symbolic one of 
replacing the differential operator d/dt by the symbol p, thereby 

^'Normal Coordinates in Dynamical Systems," Proc. Land. Math. Soc. (2), 
15, 1916. 

2 "Uber eine Formel von Heaviside zur Berechnung von Einschaltvorgange," 
Archiv. Elektrotechnik , Vol. 4, 1916. 

3 Since this paper is addressed largely to physicists and engineers, we shall employ 
to some extent the language of circuit theory rather than pure mathematics; no loss 
of essential generality is involved. 
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reducing the differential equations to an algebraic form, the formal 
solution of which we shall write 

h -m- lS0 - (1) 

Here h = hit) is the variable with whose determination we are con- 
cerned and H(p) is the Heaviside function, derived as stated from 
the differential equations of the problem. This equation is as yet 
purely symbolic, and its conversion into an explicit solution for h, 
as a function of /, constitutes the Heaviside problem. 

Bromwich l formulates the problem as the infinite integral 

lirlJc-i* pll{p) 

The writer's formulation of the problem is, that h is uniquely 
determined by the integral equation 4 



f 



h ^-" dt - pW) (3) 



This equation is valid for all values of p, for which its real part is 
greater than some finite constant c; c must be at least large enough 
to make the infinite integral converge. In the majority of physical 
problems this constant may be taken as 0; in some, however, the 
equation is valid only when c is greater than some finite constant. 

The equivalence of (2) and (3) is very easily established in a num- 
ber of ways; perhaps the simplest is to show, following March, 6 that 
(2) is the formal solution of (3). Either can be deduced from the 
other. The Bromwich solution can, of course, be derived directly 
from the Heaviside problem, as shown below. 

I 

One of the most interesting and perhaps the least generally under- 
stood of Heaviside's methods of solving the operational equation is 
the process whereby he derives a series solution, usually divergent 
and asymptotic, in inverse fractional powers of t. What I have termed 
the Heaviside Rule 6 for deriving this type of solution may be formu- 
lated as follows: 

* "The Heaviside Operational Calculus," B. S. T. J., 1922; Bulletin Amer. Math. 
Soc, 1926. 

'"The Heaviside Operational Calculus," Bulletin Amer. Math. Soc, 1927. 

8 In terming this process the Heaviside Rule I do not in any sense imply that 
Heaviside himself would have applied it incorrectly. In fact in one case he adds 
an extra term which contributes to numerical accuracy although the series itself is 
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If the operational equation h = 1/H(p) admits of formal series 
expansion in the form 

h = a + aiV/> + <Hp + a 3 p^fp + a t p 2 + . . . , (4) 

a solution, usually divergent and asymptotic, results from discarding the 

r- d n 1 

terms in integral powers of p, and replacing p n -\p by -3— -= , whence 

at -yl^i 

*^ fli + { ffll + a.|+a.i+ ~'}q=' (5) 

As stated in a forthcoming paper, this divergent series is a true 
asymptotic expansion, as defined by Poincare, if and only if, the 
singularities in 1/H(p) all lie to the left of the imaginary axis in the 
complex plane. Otherwise the series may require the addition of 
an extra term or factor, or even be quite meaningless. 

An excellent illustration of the preceding principle is furnished by 
the operational equation, 

fc=-r4=r (6) 

For convenience and without loss of essential generality we take 
|\| = 1 and X = e ; that is, the parameter X may lie anywhere on a 
circle of unit radius in the complex plane. 

Now the solution of (6) is easily derived by well known processes 
of the operational calculus: it is 

1 C % p~ Xt 

m -£^r^ dT (7) 

= — f ,- dr. (8) 

x Jo "VrV/ - t 

The solution is also known to be 7 

h(t) = e-tWlJj) , (9) 

where /o(X) is the Bessel function Jo(ix). 

a true asymptotic expansion. On the other hand Heaviside in his frequent appli- 
cations of the Rule gives no hint or indication of the restrictions imposed on its 
applicability. Fortunately in most applications of the operational calculus to physi- 
cal problems, the Rule leads to correct results. 

7 See formula (p) of the table of integrals in Chap. IV, "Electric Circuit Theory 
and Operational Calculus." 
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Now return to the operational equation (6), and expand as follows, 
without reference to convergence, 

-i(-i(9+M§)(§)«)'--)* 

Application of the Heaviside Rule now gives the divergent solution 



. , , i / i \ , r--3°- ( i y , iVttx/ 



1! \4X// 2! ' \4X// 
~ S(X/). (10) 

We have now to distinguish three cases: 

1. Xb > 0. (Real part of X > 0.) 

In this case it can be shown from (7) that 8 

h(t)~S(\t) (11) 

and that the Heaviside Rule leads to a true asymptotic expansion, 
as denned by Poincare. When X = 1, by the known expansion of 
the right hand function in equation (9) we find that the error com- 
mitted by stopping with any term in the divergent series is less than 
that term. This property, however, does not characterize the series 
for all complex values of X for which the real part is positive. 

2. X R < 0, X = - n, hr > 0. 

In this case, comparison of (8) with (7), gives by aid of (11), 

h{t) ~ e»'S(j*t), (12) 

which again is a true asymptotic expansion. The expansion differs, 
however, from that given by the Heaviside Rule, by the factor e" 1 , 
and the alternation in sign of the odd terms of the series. 

3. X« = 0, X = ita. 

In this case it is easily shown that 9 

h{t) = e-™*J*(jj) , (13) 

where J is the Bessel function of order zero. From the known 
asymptotic expansion of this function, we find that 

h{t) ~ e- (< "' /2) [e (<U ' /2) 5(ico/)] R ea. Part (14) 

with an error less than the last term included. 

8 L.c. by the process described in Chap. V. 

9 L.c. formula («) of table of integrals, Chap. IV. 
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Perhaps the simplest way of establishing the Heaviside Rule for 
the asymptotic solution of the operational equation h = l/H(p) and 
the conditions under which it is valid, is as follows: We start with the 
integral equation 

f h(t)er*'dt = t/pH(p) (15) 

Jo 

and specify that the singularities of l/pH(p) and its derivatives are 
all confined to the left hand side of the complex plane, except at the 
point p = 0, in the neighborhood of which 

= % + a-i + a-Ap + a 3 p + a^4~p H . (16) 



pHip) jp 

In other words, l/pH(p) admits of expansion in powers of -\p. 
Now since 

"°—dt = - 
Vtt7 4p 

we have from (15) 



I" - -dl - -J- (17; 

Jo 



VS/ PH(P) Ap 



r(h - )r '-'dl- - 1 ; ii . -•■•;•.. (is) 



By virtue of the restrictions imposed on l/pH(p), equation (18) is 
valid at p = 0, whence by (16) 

f( A -^ = °- (19) 

Now differentiate (18) with respect to p\ we get 

f(*-£)***--*Us-S)- (20) 

Now add | ^ ^=L d* to the left of (20) and its value o 2 /2Vp to 
Jo l Vtt/ 

the right hand side; we have 

f(*-& + 3£)^--*Us-3) + * M 
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Now set p = 0; from (16) we have 



f( 



Vtt7 2/ v?rf 



a formula which again is valid by reason of the restrictions imposed 
on l/pH(p). 
Proceeding in this manner we get the formula 



where 



f (h - S n )-t"dt = (- l)"n!fl 2 „ + i, (23) 

Jo 



e - 1 / „ ag _i_ 1 ? ° 4 

5B_ vsr°"2i +1 - 3 (2/)s 



+ (- l)»1.3.»(2n- 1) '"' 



(20 » 

= first (« + 1) terms of the divergent Heaviside series. (24) 

Also since 

c s i ( n^-i LLmiSt+il ^aa (25 ) 

5 n+ i-^„ + ( i) (2i)B+1 ^ i«; 

we have from (23) by changing n to (« + 1), 



f( 



fc _ 5 - (- 1)"+' L3 -" (2W+1) ^ ) t n +l(U 

11 * n { l) (20 " +1 V^ ' 



= (- 1)"+ 1 (« + l)!fl2n+3. (26) 



Equations (23) and (26) establish the fact that (h - S n ) converges, 
for indefinitely great values of t, at least as rapidly as l//"+W/, since 
otherwise the integrand of (26) would diverge; stated in mathematical 
notation 

h- S n = 0(l//"+ 3 ' 2 ). (27) 

Consequently the series 5 when divergent is a true asymptotic ex- 
pansion, as defined by Poincare, of the function k. 

The foregoing says nothing, it will be noted, regarding the error 
committed when 5„ is employed to compute the function h. Nothing, 
in general, can be said about this question, which requires an inde- 
pendent investigation in every specific problem. In some cases the 
error will be less than the magnitude of the last term of 5„, but this 
is the exception rather than the rule. In other exceptional cases the 
series may even be absolutely convergent. 
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The foregoing results can undoubtedly be derived by integration 
of the Bromwich integral (2) along the contour suggested by March 
{I.e.). Wiener in his paper on "The Operational Calculus" {Math. 
Annalen, Bd. 95, 1925) gives an entirely different treatment of the 
problem. The operational calculus he deals with, however, differs 
under some circumstances from that of Heaviside, as Wiener himself 
remarks. A paper by Tibor v. Stacho on "Operatoren Kakul von 
Heaviside und Laplaceshe Transformation" (publication 1927 VI 15 
by the Hungarian University, Francis Joseph) may also be consulted. 

II 

Subject to certain well known restrictions a function /(/) can be 
expressed as the Fourier integral 

f(t) = j- j F(p)e>*dp. (28) 

the path of integration being along the imaginary axis. We assume 
for the moment that this equation is valid. 

Now suppose that/(/) represents a force applied to an electrical or 
dynamic system whose "steady state" or forced response to an applied 
force F{p)e pt is 

H{p) e * 

Then the forced response g{t) of the system to the applied force /(/) 
is given by 

M-hCM™*- (29) 

However, in applying the foregoing to the Heaviside problem we 
encounter an initial difficulty. This is that if f[t) is taken as the unit 
function (zero before unity after, / = 0) it does not admit of formu- 
lation as the Fourier integral (28). The unit function, however, when 
multiplied by e~ ct when c is a positive real constant, does admit of such 
formulation, and it is easy to show that the unit function itself is 
given by 

e pt 



2 iri Jc— 



"H-* 00 _„< 



■dp c > 0. (30) 

P 



Consequently, if the unit function is the force impressed on the sys- 
tem, the forced response is 

piirp) 



k{t)=^-.{ TWrr.dp e>0. (31) 
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If now all the singularities of the integrand lie to the left of the imag- 
inary axis, then k{t) = //(/•) and (31) is the formulation of (he 
Heaviside problem. Suppose, however, that the electrical or dynamic 
system specified by H(p) is "unstable"; that is, it contains some 
internal source of energy which makes its transient oscillations in- 
crease with time / instead of dying away. In such a case II{p) 
will have zeros to the right of the imaginary axis, and in order that 
(31) shall be the solution of the Heaviside problem, c must be taken 
so large that all the singularities of the integrand lie to the left of 
the path of integration. Consequently 



J_ r + ' w e»< ,,„ (2) 

2iri.L iao pll{p) 

provided c is so chosen that all the singularities lie to the left of the 
path of integration in the complex plane. This is Bromwich's formu- 
lation of the Heaviside problem. 1 " 

From the foregoing it follows that the Fourier integral 



Ik I J -i 



pH(P) 



dp (2a) 



is, in general, the formulation of the Heaviside problem if and only 
if, all the singularities of the integrand lie to the left of the imaginary 
axis. If there are singularities on the imaginary axis, the integral 
is ambiguous, while if there are singularities to the right of the im- 
aginary axis, the integral gives an incorrect solution of the Heaviside 
problem. 11 

As a simple example consider the operational equation 



h = \/II(p) = 



/> 



P-P 



where the real part /3 r of /3 is positive. The correct solution as given 
by either (2) or (3) is 

// = t < 

= i fil t> 0, 

10 The appropriate mathematical methods of solving the infinite integral (2) are 
dealt with in great detail by Jeffreys in his "Operational Methods in Mathematical 
Physics" (Cambridge University Tracts). 

11 To prevent misunderstanding it should be stated that the application, when 
permissible, of the classical Fourier integral (2a) to the Heaviside problem, was 
known long prior to the work of Broimvich. Bromwich's essential and important 
contribution lay in showing that the path of integration must be shifted to the 
right of all the singularities, together with a verification of an important form of 
solution, first given by Heaviside, of the operational equation. 

11 
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whereas the Fourier integral (2a) gives 

h = - e Bt t < 0. 

= t > 0. 

There is another reason why care must be exercised in applying 
the classical Fourier integral to the Heaviside problem. This is that 
in solving the operational equation, h = \/H(p), the appropriate 
expansion of \/H(p) may introduce singularities on or to the right of 
the imaginary axis in the component terms. This offers no difficulty 
if either (2) or (3) is employed, but renders the Fourier integral (2a) 
inapplicable. As an example consider the equation 



V?+i" 



One form of solution is gotten by multiplying numerator and denomi- 
nator by V/> — 1, whence 

V? 1 



/;. = 



p - 1 p - 1 



and each term has a singularity at p = 1. 

A physical interpretation of the foregoing may not be without 
interest. Suppose that an elementary force F(p)e pl dp, where p = 
c + to, is applied at an indefinitely remote past (negative) time to a 
system specified by H(p). The response of the system is then 

F{p) -e^dp+T v {t)dp, 



H(p) 



where T p (t)dp is the concomitant transient or characteristic oscillation 
of the system. If c is chosen sufficiently large then at least for / > 
the transient term can be made as small as we please compared with 
the first term. Finally if the impressed force is the unit function 
(zero before, unity after, time / = 0) and it is written as 

»e+«ot> 



2TriJ c _ im p 



the total response and therefore h(t) is given by 



_L f 

2iriJ c _ ta > 



c +*» -tp 



c 



pll(p) 



dp, 
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provided c is sufficiently large to make the transient term 



/^C-fla 

J c— loo 



e-floo 

T p (t)dp 



negligibly small. Analytically this requires that c be so large that 
the zeros of pll(p) shall all lie to the left of the axis p R = c. 

Ill 

The foregoing discussion tacitly assumes the existence of an unique 
solution of the operational equation. On the part of the physicist 
this assumption is entirely proper because if the operational equation 
is the symbolic formulation of a correctly set physical problem an 
unique solution must and does exist. When approached from the 
purely mathematical standpoint, however, the case is different and 
there is no assurance of the existence of a solution. As an example 
consider the operational equation 

h = e p 

The corresponding integral equation 



/•00 

- = h(t)e-i"dt pa > 

P Jo 



has no solution, while Bromwich's formula 

»C+i30 



Hi) 



1 T c+ e" 
= -^ -e"'dp 

2TriJ c _ tao p 



gives h = / < — 1 

= 1 / > - 1 

which is obviously incorrect. As a matter of fact the operational 
equation itself has no solution. 

To formulate the necessary and sufficient conditions for the exis- 
tence of a solution we may proceed as follows: If a solution exists 
it is given by either of the equations 

/.IT l J c -ta) 

/»00 

HP) = h{t)e- pt dt p R > c, (3) 

Jo 
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where f(p) denotes l/pH(p). Substitution of the value of //(/), as 
given by (2), in (3), gives the transform 

f(p) = ± e-»<dt f(z)e"dz. (32) 



In addition, since //(/) = for / < 0, we must have 

•c+loo 



— - I f(p)e l "dp - when t < 0. 

IlTl Jc-ia, 



(33) 



Equations (32) and (33) formulate the necessary and sufficient 
restrictions on f(p) for the existence of a solution of the operational 
equation 

h = pf(p) = l/II(p). 

To correlate the transform (32) more closely with the classical 
Fourier transform, write p = u + i<a and 

f(u + iui) = 0(co) u and a> real. 
Then the transform (32) becomes 

0(o,)=— e-«"dt I tWdx (34) 

ZXt/0 i^-oo 

for all values of u > c. Also since h(t) = 0, for / < 0, the lower 
limit of integration with respect to / in (33) may be replaced by — °o , 
whence 



*(«) 



= ^- I e-' u 'rf/ I 4>(x)e u *dx, (35) 



which is the classical Fourier transform. 

The foregoing naturally suggests a few remarks regarding the mode 
of approach to the operational calculus. If we regard, as Heaviside 
certainly did, the operational equation as the symbolic formulation 
of a definite physical problem, it is not permissible to define the sig- 
nificance of the operator p a priori. The meaning of the operator p 
and methods of solution of the equation must be so determined as 
to give the correct solution of the original physical problem. Heavi- 
side's procedure here was purely heuristic and "experimental"; equa- 
tions (2) and (3), however, provide a sound logical basis for the de- 
velopment of the operational calculus. On the other hand, from the 
purely mathematical standpoint it is possible to develop an opera- 
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tional calculus on the basis of certain mutually consistent definitions 
and conventions adopted at the outset, just as it is possible to develop 
different geometries and algebras. An operational calculus so devel- 
oped, however, may or may not agree with that of Heaviside and 
may or may not give the correct solution of the Heaviside problem. 
In a number of recent papers on the Heaviside operator this procedure 
has been adopted. To the writer this appears both illogical and 
doubtful, and is certainly not the method of Heaviside himself, as is 
sometimes implied. 

In the interpretation of the operational equation h = l/H(p) it is, 
in the writer's opinion, extremely important to recognize the fact that 
it is not a true equation and has no iiterai significance of itself, but is 
simply and solely the symbolic or shorthand way of writing down 
equation (2) or its equivalent (3). If this fact is kept clearly in mind 
the 'operator' p loses the mysterious character it seems to possess for 
so many students and all real danger of misinterpretation and incorrect 
solution is eliminated. In the writer's opinion, Heaviside's achieve- 
ment in the development of his operational calculus does not consist in 
inventing a novel and mysterious kind of mathematics, but in formu- 
lating a body of rules and processes whereby recourse to the actual 
equations of the problem is rendered unnecessary. 

There is another fact which it is also important to clearly recognize. 
In the original differential equations from which the operational equa- 
tion is derived, the symbol p n denotes d n jdl n and its reciprocal p~ n , 
corresponding multiple integration, and the index n is always integral. 
If, as in the case in important electrotechnical problems, non-integral 
or fractional powers of the symbol p occur in the operational equation, 
it is due to algebraic manipulations and operations, which in essence 
rob p of its original significance. That is to say, in such cases it is not 
permissible nor indeed possible to assign to the operator p its original 
significance. For example the operational equation 



// = V/> 



does not mean 



/d\ U2 
hit) = 1-T-) -1 (1 = unit function) 



which is itself meaningless, but simply 



1 r-c+tn p tp 

//(o = T ^ V r// c>0 
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or 



_l r 



h(t)e-" l dt p R > 



More broadly stated, the operational equation is the shorthand state- 
ment of true equations in which p has lost its original significance and 
is simply the complex argument of functions which obey all the laws of 
algebra and analysis. 

Failure to recognize these simple principles is responsible for a large 
amount of confusion, loose reasoning and profitless discussion of so 
called 'fractional differentiation,' a term which, to the writer at least, 
is quite meaningless. On the other hand, their recognition should go 
far towards removing whatever mystery may have surrounded the 
Heaviside operator and the Heaviside processes. 



CORRECTION SLIP FOR ISSUE OF JANUARY, 1930 
Page 153: Equation (10, should read 

//(/) ~ S(\t) (10) 



